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generating range data comprising a second plurality of three-din^^nsional points from the 
plurality of two-dimensional images using a range-data process; 

fusing the range data to the shape-from-shading data, yieldii;*^ fused data comprising a 
third plurality of three-dimensional points; 

registering the fused data, yielding registered data comprising a fourth plurality of three- 
dimensional points; and 

triangulating the registered data, yielding at least ^fte three-dimensional image of the oral 

cavity. 

25. (Nev^) The computerized method of clainy24, wherein the generating shape-from- 
shading data further comprises: 

estimating the direction of the illuminaJit from the plurality of two-dimensional images, 
in reference to camera intrinsic parameters;>and 

determining a solution to a brightness equation, yielding the shape-from-shading data 
comprising a first plurality of three-diniensional points. 

26. (New) The computerized method of claim 24, wherein the fusing the range data to the 
shape-from-shading data further comprises: 

calculating the error difjference in available depth measurements of the range data and the 
shape-from-shading data; 

approximating a syface the fits the error difference, yielding an approximated surface; 

and 

correcting theihape-from-shading data from the approximated surface, yielding fiised 
data comprising a tj;fird plurality of three-dimensional points. 

REMARKS 

Applicant has reviewed the Office Action mailed on November 6, 2002. Claims 1, 5, 8, 
1 1 and 20 are amended and claims 21-26 are added; as a result, claims 1 - 26 are now pending 
in this application. 
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§102 Rejection of the Claims 

Claims 1-4, 8-10 and 16-19 were rejected under 35 USC § 102(e) as being anticipated by 
Carmeli et al. (U.S. 6,414,708). 

Regarding amended independent claim 1, Applicant is unable to find, among other 
things, in the cited portions of Carmeli a method where shape-fi-om-shading (SFS) data and 
range data are generated fi-om the two-dimensional images, and where the SFS data and the 
range data are processed to generate the three-dimensional image(s), as recited in amended claim 
1. Claims 2-4 depend on claim 1 , are believed to be patentable at least for the reasons stated 
with respect to amended claim 1. Additionally, with respect to claim 3, Applicant is unable to 
find in the cited portions of Carmeli a method where a physical cast of the oral cavity is 
constructed fi-om the three-dimensional image, as recited in the claim. Applicant respectfiilly 
requests withdrawal of the rejection, and reconsideration and allowance of claims 1 - 4. 

Regarding amended independent claim 8, Applicant is unable to find, among other 
things, in the cited portions of Carmeli a computer-readable medium having computer- 
executable instructions to cause a computer to generate SFS data and range data using the 
plurality of two-dimensional images, and process the SFS data and the range data to generate the 
at least one three dimensional image, as recited in amended claim 8. Claims 9 and 10 depend on 
claim 8, and are believed to be patentable at least for the reasons stated with respect to amended 
claim 8. Additionally, with respect to claim 9, Applicant is unable to find in the cited portions of 
Carmeli a physical cast of the oral cavity constructed from the three-dimensional image, as 
recited in the claim. Applicant respectfiilly requests withdrawal of the rejection, and 
reconsideration and allowance of claims 8-10. 

Regarding independent claim 16, Applicant respectfiilly traverses the rejection. The 
Office Acfion fails to make out proper prima facie anticipation because Carmeli does not 
describe all of the elements of claim 16. For example, Carmeli does not describe generating 
shape-from-shading data that is generated from a direction of an illuminant of the jaw that is 
esfimated in reference to camera intrinsic parameters, as is recited in the claim. Applicant 
requests reconsideration and allowance of claim 16. 

Regarding independent claim 17, Applicant respectfiilly traverses the rejection. 
Applicant is unable to find, among other things, in the cited portions of Carmeli, both a digitizer 
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providing five degrees of freedom, and a computer receiving coordinate measurements from the 
digitizer and generating a digital three-dimensional model from the coordinate measurements, as 
recited in the claim. Claims 18 and 19 depend on claim 17, and are believed to be allowable at 
least for the reasons provided with respect to claim 17. Additionally, with respect to claim 18, 
Applicant is unable to find in the cited portions of Carmeli a rapid prototyping machine operably 
coupled to the computer, receiving the digital three-dimensional model and generating a physical 
model of the digital three-dimensional model, as recited in claim 18. Further, with respect to 
claim 19, Applicant is unable to find in the cited portions of Carmeli, a display operably coupled 
to the computer, receiving the digital three-dimensional model and generating an image of the 
digital three-dimensional model, as recited in claim 19. Applicant respectfully requests 
withdrawal of the rejection, and reconsideration and allowance of claims 17-19. 

Applicant does not admit that Carmeli is prior art under 35 U.S.C. § 102(e), and reserves 
the right to swear behind it at a later date. Nevertheless, Applicant respectfully submits that the 
claims are distinguishable over Carmeli for the reasons provided above. 



Claims 14 and 15 were allowed. Applicant thanks the Examiner for allowing the claims. 

Claims 5-7, 11-13 and 20 were objected to as being dependent upon a rejected base 
claim, but were indicated to be allowable if rewritten in independent form including all of the 
limitations of the base claim and any intervening claims. 

New claim 21 recites language found in unamended claims 1 and 5. New claims 21-23 
generally correspond to claims 5-7. New claim 24 recites language found in unamended claims 
8 and 11. New claims 24-26 generally correspond to claims 11-13. 

Claims 5-7 depend on and are believed to be patentable with amended independent claim 
1. Claims 11-13 depend on and are believed to be patentable with amended independent claim 8. 
Claim 20 depends on and is believed to be patentable with independent claim 17. 



Allowable Subject Matter 
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Conclusion 

Applicant respectfully submits that the claims are in condition for allowance and 
notification to that effect is earnestly requested. The Examiner is invited to telephone 
Applicant's attorney ((612) 373-6960) to facilitate prosecution of this application. 

Please charge the additional claims fee of $138.00, and any additional fees deemed 
necessary, to Deposit Account No. 19-0743. 

Respectfully submitted, 
ALY A. FARAG ET AL. 
By their Representatives, 

SCHWEGMAN, LUNDBERG, WOESSNER & KLUTH, P.A. 
P.O. Box 2938 
Minneapolis, MN 55402 
(612)373-6960 



Da.e 2-H-03 By L lU- 



larvin L. Beekman 
Reg. No. 38,377 
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Please replace the previously pending claim set with the claims, as amended, below: 



V 



1. (Amended) A computerized method for dental imaging comprising: 
receiving a plurality of two-dimensional images of a oral cavity; and 
generating at least one three-dimensional image of the oral c^ity from the plurality of 
two-dimensional images, including: 

generating shape-from-shading (SFS) data and ran^e data using the plurality of 

two-dimensional images; and 
processing the SFS data and the range data to generate the at least one three- 
dimensional image. 



2. The computerized method of claim 1, wherein the/^plurality of two-dimensional images 
further comprises a plurality of two-dimensional optica/images. 

3. The computerized method of claim 1, furtheycomprising: 
constructing a physical cast of the oral cavity from the three-dimensional image. 

4. The computerized method of claim 1, further comprising: 
generating the plurality of two-dimensi()nal images of the oral cavity from a common 

reference point in three-dimensional space. 
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5. (Amended) The computerized method of claim 1, wherein processing the SFS data and 
the range data to generate the at least one three-dimensional images comprises: 

fusing the range data to the shape-from-shading data, yieldipg fused data comprising a 
third plurality of three-dimensional points; 

registering the fused data, yielding registered data compi/sing a fourth plurality of three- 
dimensional points; and 

triangulating the registered data, yielding the at least ^Irie three-dimensional image of the 
oral cavity. 



6. The computerized method of claim 5, wherein th^ generating shape-from-shading data 
fiirther comprises: 

estimating the direction of the illuminant from/the plurality of two-dimensional images, 
^ ^/ j in reference to camera intrinsic parameters; and 

determining a solution to a brightness equation, yielding the shape-from-shading data 
comprising a first plurality of three-dimensional points. 



7. The computerized method of claim 5, wherein the ftising the range data to the shape- 
from-shading data fiirther comprises: 

calculating the error difference in avaij'able depth measurements of the range data and the 
shape-from-shading data; 

approximating a surface the fits the ^rror difference, yielding an approximated surface; 

and 

correcting the shape-from-shading^ data from the approximated surface, yielding fiased 
data comprising a third plurality of three/dimensional points. 
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8. (Amended) A computer-readable medium having computer-executable instructions to 
cause a computer to perform a method comprising: 

receiving a plurality of two-dimensional optical im^iges of an oral cavity; and 
generating at least one three-dimensional imag^of the oral cavity from the plurality of 
two-dimensional images, including: 

generating shape-from-shading (Sf S) data and range data using the plurality of 

two-dimensional imagers; and 
processing the SFS data an^he range data to generate the at least one three- 
dimensional ima£ 



9. The computerized method of claim 8, further comprising: 
constructing a physical cast of the oral cavity from the three-dimensional image. 

10. The computerized metftod of claim 8, further comprising: 

generating the plurality o\ two-dimensional images of the oral cavity from a common 
reference point in three-dimensionVl space. 



1 1 . (Amended) The (Computerized method of claim 8, wherein processing the SFS data and 
the range data to generate the at least one three-dimensional images comprises: 

fusing the range data\o the shape-from-shading data, yielding fused data comprising a 
third plurality of three-dimensfbnal points; 

registering the fused data^yielding registered data comprising a fourth plurality of three- 
dimensional points; and 

triangulating the registered d^ta, yielding the at least one three-dimensional image of the 
oral cavity. 
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12. The computerized method of claim 11, wherein the generating s^ape-from-shading data 
further comprises: 

estimating the direction of the illuminant from the plurality /f two-dimensional images, 
in reference to camera intrinsic parameters; and 

determining a solution to a brightness equation, yielding the shape-from-shading data 
comprising a first plurality of three-dimensional points. 

13. The computerized method of claim 11, wherein t^^ fusing the range data to the shape- 
from-shading data fiirther comprises: 

calculating the error difference in available de^th measurements of the range data and the 
shape-from-shading data; / 

approximating a surface the fits the error difference, yielding an approximated surface; 
and I 

correcting the shape-from-shading data /from the approximated surface, yielding fused 
data comprising a third plurality of three-dimensional points. 

14. A three-dimensional digital image of a human oral cavity produced by the process 
comprising: j 

generating a plurality of two-dimensional optical images of the oral cavity from a 
common reference point in three-dimensional space; 

generating shape-from-shading data from the plurality of two-dimensional images using a 
shape-from-shading process, the shape-from-shading data comprising a first plurality of three- 
dimensional points; j 

generating range data comprising a second plurality of three-dimensional points from the 
plurality of two-dimensional images using a range-data process; 

fiising the range data to^the shape-from-shading data, yielding fiised data comprising a 
third plurality of three-dimensional points; 
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registering the fused data, yielding registered data comprising a fourth pluraHty of three- 
dimensional points; and / 

triangulating the registered data, yielding the one three-dimensional image of the oral 

cavity. 

15. The three-dimensional digital image of a human oral ca/ity of claim 14, produced by the 
process wherein generating shape-from-shading data further comprises: 

estimating the direction of the illuminant from the plurality of two-dimensional images, 
in reference to camera intrinsic parameters. 

16. A system for dental diagnosis comprising: 
a processor; and 

software means operative on the processor for generating a three-dimensional image of a 

/ 

human jaw, including generating shape-fi-om-shading data that is generated from a direction of an 
illuminant of the jaw that is estimated in reference to camera intrinsic parameters. 



17. A computerized system comprising: 

a digitizer providing five degrees/of freedom, having an arm; 

a charge coupled device camera^ rigidly mounted on the arm of the digitizer; and 

/ 

a computer, operably couplec^to the digitizer and the camera; receiving coordinate 
measurements from the digitizer and a plurality of two-dimensional images from the camera; and 
generating a digital three-dimensional model from the coordinate measurements and from the 
plurality of two-dimensional images. 



18. The computerized system of claim 17, further comprising: 

a rapid prototyping r^achine operably coupled to the computer, receiving the digital three- 
dimensional model and generating a physical model of the digital three-dimensional model. 
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19. The computerized system of claim 17, fiirthffer comprising: 

a display operably coupled to the compuxer, receiving the digital three-dimensional model 
and generating an image of the digital three-mmensional model. 



20. (Amended) Tfte computerized system of claim 1 7, the computer further comprises: 
a computer readahJe medium comprising means of: 

generating shape-from-shading data from the plurality of two-dimensional images using a 
shape-from-shading process, t\e shape-from-shading data comprising a first plurality of three- 
dimensional points; 

generating range data compldsing a second plurality of three-dimensional points from the 
plurality of two-dimensional images using a range-data process; 

fusing the range data to the shapVfrom-shading data, yielding fused data comprising a 
third plurality of three-dimensional points]\ 

registering the fused data, yielding registered data comprising a fourth plurality of three- 
dimensional points; and 

triangulating the registered data, yielding Vie ima^e of the three-dimensional model. 

21. A computerized method for dental imaging/comprising: 
receiving a plurality of two-dimensional usages of a oral cavity; and 

generating shape-from-shading data frdn the plurality of two-dimensional images using a 
shape-from-shading process, the shape-from4hading data comprising a first plurality of three- 
dimensional points; and 

generating range data comprising a second plurality of three-dimensional points from the 
plurality of two-dimensional images using a range-data process; 

fusing the range data to the ^ape-from-shading data, yielding fused data comprising a 
third plurality of three-dimensional points; 

registering the fused data/ yielding registered data comprising a fourth pluraUty of three- 
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dimensional points; and 

N^angulating the registered data, yielding at least one three-dimensional image of the oral 
cavity. \ 

22. The computerized method of claim 21, wherein the generating shape-from-shading data 
further comprises: 

estimatingsthe direction of the illuminant from the plurality of two-dimensional images, 
in reference to came^ intrinsic parameters; and 

determining a solution to a brightness equation, yielding the shape-from-shading data 
comprising a first pluralMy of three-dimensional points. 

23. The computerized method of claim 21, wherein the fusing the range data to the shape- 
from-shading data further comprises: 

calculating the error difference in available depth measurements of the range data and the 
shape-from-shading data; \ 

approximating a surface tne fits the error difference, yielding an approximated surface; 
and \ 

correcting the shape-from-shading data from the approximated surface, yielding fused 
data comprising a third plurality of thrWdimensional points; 

24. A computer-readable medium having computer-executable instructions to cause a 
computer to perform a method comprising: \ 

receiving a plurality of two-dimensio^l optical images of an oral cavity; and 
generating shape-from-shading data from the plurality of two-dimensional images using a 
shape-from-shading process, the shape-from-shaMing data comprising a first plurality of three- 
dimensional points; \ 

generating range data comprising a second pVrality of three-dimensional points from the 
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plurMity of two-dimensional images using a range-data process; 

Musing the range data to the shape-from-shading data, yielding fused data comprising a 
third plurality of three-dimensional points; 

registering the fused data, yielding registered data comprising a fourth plurality of three- 
dimensional points; and 

triangulating the registered data, yielding at least one three-dimensional image of the oral 
cavity. \ 

25. The computerized method of claim 24, wherein the generating shape-from-shading data 
further comprises: \ 

estimating the diWtion of the illuminant from the plurality of two-dimensional images, 
in reference to camera intrinsic parameters; and 

determining a solution to a brightness equation, yielding the shape-from-shading data 
comprising a first plurality onthree-dimensional points. 

26. The computerized methbd of claim 24, wherein the fusing the range data to the shape- 
from-shading data further comprises: 

calculating the error difference in available depth measurements of the range data and the 
shape-from-shading data; \ 

approximating a surface the fitsihe error difference, yielding an approximated surface; 
and \ 

correcting the shape-from-shading data from the approximated surface, yielding fused 
data comprising a third plurality of three-dimVsional points. 



